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Abstract 

Let M be a smooth connected and complete manifold of dimension n, and A be a 
smooth nonholonomic distribution of rank m < n on M. We prove that, if there exists a 
smooth Riemannian metric on A for which no nontrivial singular path is minimizing, then 
there exists a smooth repulsive stabilizing section of A on M. Moreover, in dimension three, 
the assumption of the absence of singular minimizing horizontal paths can be dropped in 
the Martinet case. The proofs are based on the study, using specific results of nonsmooth 
analysis, of an optimal control problem of Bolza type, for which we prove that the cor- 
responding value function is semiconcave and is a viscosity solution of a Hamilton- Jacobi 
equation, and establish fine properties of optimal trajectories. 

1 Introduction 

Throughout this paper, M denotes a smooth connected manifold of dimension n. 
1.1 Stabilization of nonholonomic distributions 

Let A be a smooth distribution of rank to < n on M, that is, a rank m subbundle of the tangent 
bundle TM of M. This means that, for every x £ M, there exist a neighborhood V x of x in 
M, and a TO-tuple (/f , . . . , /^J of smooth vector fields on V x , linearly independent on V x , such 
that 

A(y) = Span{/f (y), . . .,/£(»)} , Vy € V x . 

One says that the m-tuple of vector fields (/f, . . . ,/„) represents locally the distribution A. 
The distribution A is said to be nonholonomic (also called totally nonholonomic e.g. in [3]) if, 
for every x £ M, there is a TO-tuple (/f , . . . , /^) of smooth vector fields on V x which represents 
locally the distribution and such that 

i-H/,' /,:' ! ■://> i.,M. \/ y eV x , 

that is, such that the Lie algebra spanned by /f , . . . , f? n , is equal to the whole tangent space 
T y M, at every point y £ V x . This Lie algebra property is often called Hormander's condition. 

An horizontal path joining xq to x\ is an absolutely continuous curve 7(-) : [0, 1] — ► M 
such that 7(0) = x , 7(1) = x\, and such that j(t) £ A(7(i)), for almost every t G [0,1]. 
According to the classical Chow-Rashevsky Theorem (see [21 HH1 1331 121] ) , since the distribution 
is nonholonomic on M, any two points of M can be joined by an horizontal path. 

Let A be a nonholonomic distribution and x £ M be fixed. We recall that, for a smooth 
vector field X on M, the dynamical system x = X(x) is said to be globally asymptotically stable 
at the point x, if the two following properties are satisfied: 
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Lyapunov stability: for every neighborhood V of i, there exists a neighborhood W of x 
such that, for every x £ W, the solution of x(t) = X(x(t)),x(0) = x, satisfies x(t) £ V, 
for every t > 0. 

Attr -activity: for every x £ M, the solution of x(i) = X(x(t)), x(Q) — x, tends to x as t 
tends to +00. 

The stabilization problem for nonholonomic distributions consists in finding, if possible, a 
smooth stabilizing section X of A, that is, a smooth vector field X on M satisfying X(x) € A(x) 
for every x £ M, such that the dynamical system x — X{x) is globally asymptotically stable 
at x. 

There exist two main obstructions for a distribution to admit a stabilizing section. The 
first one is of global nature: it is well-known that, if the manifold M admits such a dynamical 
system, then it possesses a smooth Lyapunov function, i.e., a Morse function having only one 
(possibly degenerate) critical point in M. In consequence, M must be homeomorphic to the 
Euclidean space M™ (we refer the reader to [39] for further details). The second one is of local 
nature: due to Brockett's condition (see [13l Theorem 1, (iii)]; see also £231 S4] ) , the distribution 
A cannot admit a smooth stabilizing section whenever m < n. 

The absence of smooth stabilizing sections motivates to define a new kind of stabilizing 
section. The first author has recently introduced the notion of smooth repulsive stabilizing 
feedback for control systemt0 (see [311 SOI SI])) whose definition can be easily translated in 
terms of stabilizing section. 

Let x £ M be fixed. Let S be a closed subset of M and X be a vector field on M. The 
dynamical system x = X(x) is said to be smooth repulsive globally asymptotically stable at x 
with respect to S (denoted in short SRS Sj s) if the following properties are satisfied: 

(i) The vector field X is locally bounded on M and smooth on M \ S. 

(ii) The dynamical system x — X(x) is globally asymptotically stable at x in the sense of 
Caratheodory, namely, for every x £ M, there exists a solution of 

x(t) — X(x(t)), for almost every t £ [0, 00), x(0) = x, (1) 

and, for every x £ M, every solution of (p} (called Caratheodory solution of x = X(x)) 
on [0,oo) tends to x as t tends to 00. Moreover, for every neighborhood V of X, there 
exists a neighborhood W of x such that, for x e W, the solutions of (fTJ) satisfy x(t) £ V, 
for every t > 0. 

(iii) For every x £ M, the solutions of ([J) satisfy x(t) ^ S, for every t > 0. 

In view of what happens whenever A = TM , and having in mind the above obstructions 
for the stabilization problem, a natural question is to wonder if, given a smooth nonholonomic 
distribution A, there exists a section X of A on M and a closed nonempty subset S of M such 
that X is SRSj.s. In this paper, we provide a positive answer in a large number of situations. 
To state our main results, we need to endow the distribution A with a Riemannian metric, 
thus encountering the framework of sub-Riemannian geometry, and we require the concept of 
a singular path, recalled next. 

1 If one represents locally the distribution A by a m-tuple of smooth vector fields (/],,■■■ , fm)> then the 
existence of a local stabilizing section for A is equivalent to the existence of a stabilizing feedback for the 
associated control system x = "Yl^iLi u ifi( x )- There is a large literature on alternative types of stabilizing 
feedbacks for control systems (see Section ll.4l l. 
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1.2 Sub-Riemannian geometry 

For :ro € M, let £Ia(xq) denote the set of horizontal paths 7(-) : [0, 1] — » M such that 7(0) = Xn. 
The set CIa{xo), endowed with the VF 1,1 -topology, inherits of a Banach manifold structural. 
For Xo,Xi € M, denote by Qa(xo,Xi) the set of horizontal paths 7(-) : [0, 1] — > M such that 
7(0) = x and 7(1) = £1. Note that £Ia(xo,Xi) = E~ Q (xi), where the end-point mapping 
E Xo : fiA^o) — > A/ is the smooth mapping defined by E XD (7(-)) :— 7(1). A path 7(-) is said to 
be singular if it is horizontal and if it is a critical point of the end-point mapping E Xo . 

The set Ha(xo, xi) is a Banach submanifold of Q,a{xq) of codimcnsion n in a neighborhood 
of a nonsingular path, but may fail to be a manifold in a neighborhood of a singular path. It 
appears that singular paths play a crucial role in the calculus of variations with nonholonomic 
constraints (see [17] for details and for properties of such curves). 

Let T*M denote the cotangent bundle of M, tt : T*M — > M the canonical projection, 
and ui the canonical symplectic form on T*M . Let A 1 - denote the annihilator of A in T*M 
minus its zero section. Define ZJ as the restriction of w to A- 1 . An absolutely continuous curve 
tp(-) : [0, 1] — > A 1 - such that ip(t) £ keTUj(ip(t)) for almost every t G [0, 1], is called an abnormal 
extremal of A. It is well known that a path j(-) : [0, 1] — > M is singular if and only if it is the 
projection of an abnormal extremal ip(-) of A (see [33] or [H]). The curve tp(-) is said to be an 
abnormal extremal lift of 7(-). 

Let g be a smooth Riemannian metric defined on the distribution A. The triple (M,A,g) 
is called a sub- Riemannian manifold. The length of a path 7(-) S £Ia(xq) is defined by 

length s ( 7 (-)) := J yfgywW), j(t))dt. (2) 

The sub- Riemannian distance dsn(xo,Xi) between two points Xq,xi of M is the infimum over 
the lengths (for the metric g) of the horizontal paths joining xq and x\. According to the 
Chow-Rashevsky Theorem (see O HH1 [Ml I3S] ) , since the distribution is nonholonomic on M, 
the sub-Riemannian distance is well-defined and continuous on M x M. Moreover, if the 
manifold M is a complete metric spac^l for the sub-Riemannian distance dsn, then, since M 
is connected, for every pair (xq,xi) of points of M there exists an horizontal path 7(-) joining 
xq to x\ such that 

dsii(xo,xi) = length 9 (7(-)). 

Such an horizontal path is said to be minimizing. 

Define the Hamiltonian H : T*M -^Eas follows. For every x € M, the restriction of H to 
the fiber T*M is given by the nonnegative quadratic form 

p — \ max { I v g A(x) \{0}\. (3) 

Let _ff denote the Hamiltonian vector field on T*M associated to H, that is, ij+u = —dH. A 
normal extremal is an integral curve of H defined on [0, 1], i.e., a curve ip(-) : [0, 1] — * T*M 
such that ip(t) = H(ip(t)), for t € [0,1]. Note that the projection of a normal extremal is a 
horizontal path. The exponential mapping exp a . o is defined on T* Q M by exp Xg (po) := 7r(-0(l)), 
where ip(-) is the normal extremal so that ^(0) = (xo,Po) in local coordinates. Note that 
H(ip(t)) is constant along a normal extremal ip(-), and that the length of the path ir(ip(-)) is 
equal to (2 H (V'(O))) 1 / 2 . 

According to the Pontryagin maximum principle (see [35]), a necessary condition for a 
horizontal path to be minimizing is to be the projection either of a normal extremal or of an 

2 It is a straightforward adaptation of results of Bismut 1 101 (see also [33]). 

3 Note that, since the distribution A is nonholonomic on M, the topology defined by the sub-Riemannian 
distance d^R coincides with the original topology of M (see l9l I33|). 
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abnormal extremal. In particular, singular paths satisfy this condition. However, a singular 
path may also be the projection of a normal extremal. A singular path is said to be strictly 
abnormal if it is not the projection of a normal extremal. 

A point x £ exp Xo (T* g M) is said conjugate to xq if it is a critical value of the mapping 
exp XQ . The conjugate locus, denoted by C{xq), is defined as the set of all points conjugate to 
xq. Note that Sard Theorem applied to the mapping exp Xo implies that the conjugate locus 
C(xo) has Lebesgue measure zero in M. 

Remark 1.1. It has been established in 43J that the image of the exponential mapping exp Xo 
is dense in M, and is of full Lebesgue measure for corank one distributions. 

Remark 1.2. Let x £ exp Xo (T* Q M), let p £ T* Q M such that x = exp Xo (p ), and let ip(-) 
denote the normal extremal so that ^(0) = (xq,pq) in local coordinates. If x is not conjugate 
to Xq, then the path x(-) := tt(i(i(-)) admits a unique normal extremal lift. Indeed, if it had 
two distinct normal extremals lifts ipi(-) and ip2( m ), then the extremal ipi(-) — V^G) would be 
an abnormal extremal lift of the path x(-). Hence, the path x(-) is singular, and not strictly 
abnormal, and thus, in particular, the point x is conjugate to x$. This is a contradiction. 

We also recall the notion of a cut point, required in this article. Let xo £ M; a point x £ M 
is not a cut point with respect to Xq if there exists a minimizing path joining xq to x, which 
is the strict restriction of a minimizing path starting from xq. In other words, a cut point is a 
point at which a minimizing path ceases to be optimal. The cut locus of xq, denoted by C(xq), 
is defined as the set of all cut points with respect to xq. The following result is due to [45] . 
We provide in Section [2.2.31 a new (and selfcontained) proof of this result, using techniques of 
nonsmooth analysis. 

Lemma 1.1. Let M be a smooth closed connected manifold of dimension n, and A be a smooth 
nonholonomic distribution of rank m < n on M . Let g be a metric on A for which no nontrivial 
singular path is minimizing, and let xq £ M. Then, 

(x ) C C(x ), 

where C rn i„(xo) denotes the set of points x £ M \ {xq} such that there exists a critical point 
Po £ T* Q M of the mapping exp Xg , and such that the projection of the normal extremal ip(-), 
satisfying ip(0) — (xq,Pq) in local coordinates, is minimizing between xq and x. 

In other words, under the assumptions of the lemma, every (nonsingular) minimizing tra- 
jectory ceases to be minimizing beyond its first conjugate point. 

1.3 The main results 

Theorem 1. Let M be a smooth connected manifold of dimension n, and A be a smooth 
nonholonomic distribution of rank m < n on M. Let x £ M . Assume that there exists a 
smooth Riemannian metric g on A for which M is complete and no nontrivial singular path is 
minimizing. Then, there exist a section X of A on M , and a closed nonempty subset S of M , 
of Hausdorff dimension lower than or equal to n — 1, such that X is SRSx.s- 

Remark 1.3. If the manifold M, the distribution A, and the metric g are moreover real-analytic, 
then the set S of the theorem can be chosen to be a subanalytic subset of M\{x}, of codimension 
greater than or equal to one (see [27l [28] for the definition of a subanalytic set). Note that, 
in this case, since S is subanalytic (in M \ {x}), it is a stratified (in the sense of Whitney) 
submanifold of M \ {x}. 

Remark 1.4. If m = n, then obviously there exists no singular path (it is the Riemannian 
situation) . 
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Remark 1.5. The distribution A is called fat (see [33] ) at a point x G M if , for every vector 
field X on M such that X(x) G A(x) \ {0}, there holds 

T X M = A(ar) + Span{[X,/i](i), 1 < i < m}, 

where (/i, . . . , / m ) is a m-tuple of vector fields representing locally the distribution A. 
With the same notations, it is called medium-fat at x (see |JJ) if there holds 

T X M = A(x) + Span{[/ i; fj](x), l<i,j<m} + Span{[X, [f h /_,•]] (a;), 1 < », j < m}. 

If A is fat at every point of M, then there exists no nontrivial singular path (see [33]). On 
the other part, for a generic smooth Riemannian metric g on M, every nontrivial singular path 
must be strictly abnormal (see [H]); ^ follows from [H Theorem 3.8] that, if A is medium-fat 
at every point of M, then, for generic metrics, there exists no nontrivial minimizing singular 
path. Note that, if n < m(m — 1) + 1, then the germ of a m-tuple of vector fields (/i, . . . , f m ) 
is generically (in C°° Whitney topology) medium- fat (see [4]). 

Remark 1.6. Let m > 3 be a positive integer, Q m be the set of pairs (A,g), where A is a 
rank m distribution on M and g is a Riemannian metric on A, endowed with the Whitney C°° 
topology. There exists an open dense subset W m of Q m such that every element of W m does 
not admit nontrivial minimizing singular paths (see |16[ 117]). This means that, for m > 3, 
generically, the main assumption of Theorem [1] is satisfied. 

In the following next result, we are able to remove, in the compact and orientable three- 
dimensional case, the assumption on the absence of singular minimizing paths. Assume from 
now on that M is a smooth closed manifold of dimension 3 which is orientable and denote 
by f2 an orientation form on M. Any nonvanishing one- form a generates a smooth rank- two 
distribution A defined by A := kera. Assume that A is nonholonomic on M. There exists a 
unique smooth function / on M such that a A da = fQ on M. Since A is nonholonomic, the 
se t {/ 7^ 0} is open and dense in M. The singular set Sa of A is defined by 

S A := {x g M | f(x) - 0} , 

Note that, if M and a are analytic, then the singular set is an analytic subset of M. The set 
Sa is said to be a Martinet surface if, for every x £ Sa, df(x) ^ 0, so that the set Sa is a 
smooth orientable hypersurface on M. In the sequel, we will call a Martinet distribution, any 
nonholonomic distribution A associated with a nonvanishing one-form as above such that Sa is 
a Martinet surface. In fact, it follows from the generic classification of rank two distributions on 
a three-dimensional manifold (see [38] . see also [TT]) that, for every x G Sa, the distribution A is, 
in a neighborhood of x, isomorphic to ker a, where the one-form a is defined by a := dx^— x\dx\ , 
in local coordinates (xi, X2, £3). In this neighborhood, the Martinet surface Sa coincides with 
the surface X2 = 0, and the singular paths are the integral curves of the vector field restricted 
to X2 = 0. This situation corresponds to the so-called Martinet case, and these singular paths 
are minimizing in the context of sub-Riemannian geometry, for every smooth metric g on A 
(see 0EEJI32]). 

Theorem 2. Let M be a smooth connected orientable compact Riemannian manifold of dimen- 
sion three, and A be a Martinet distribution on M . Let x G M . Then, there exist a section X 
of A on M , and a closed nonempty subset S of M , of Hausdorff dimension lower than or equal 
to two, such that X is SRS s .s- 

Remark 1.7. The compactness assumption of the manifold M can actually be dropped (see 
Remark |2.5| . It is set to avoid technical difficulties in the proof. 
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1.4 Stabilization of nonholonomic control systems 

We begin this section with a remark on the local formulation of Theorem [TJ Let U be an 
open neighborhood of x in M such that A\ v is spanned by a m-tuple (fi,---,f m ) of smooth 
vector fields on U, which are everywhere linearly independent on U. Every horizontal path 
x(-) S O(S), contained in U, satisfies 

m 

q(t) = £>(*)/<(?(*)) for a.e. t € [0,1], (4) 

i=l 

where u.; g L 1 ([0, 1], H), for i = 1, . . . , m. The function u(-) = (wi(-), . . . , u m (-)) is called the 
control associated to x(-), and the system[4]is a control system. Hence, Theorem[T] translated 
in local coordinates, yields a stabilization result for control systems of the form (j4|). 

There are however slight differences between the geometric formulation adopted in Theorem 
[TJ and the corresponding result for control systems. Indeed, when considering control systems 
of the form ([4]), the vector fields fx, ... , f m need not be everywhere linearly independent. More- 
over, a rank m distribution A on the manifold M is not necessarily globally represented by a 
m-tuple of linearly independent vector fields (for example, consider a rank two distribution on 
the two-dimensional sphere of R 3 ). 

For these reasons, we derive hereafter a stabilization result, similar to Theorem [TJ valuable 
for control systems of the form ([JJ, and of independent interest. 

Consider on the manifold M the control system 

m 

±(*) = X>(*)/i(s(*))> (5) 
»=i 

where /1, . . . , f m are smooth vector fields on M (not necessarily linearly independent), and the 
control u = (iti, . . . , u m ) takes values in H m . 

The system ([5]) is said to be (totally) nonholonomic if the m-tuple , f m ) satisfies 

Hormander's condition everywhere on M. According to the Chow-Rashevsky Theorem, any 
two points of M can be joined by a trajectory of ([5]). 

Let x € M be fixed. The stabilization problem consists in finding a feedback control function 
k = (fci, • • • , k m ) : M — > IR™ 1 such that the closed-loop system 

1 

x = y^h(x)fj(x) (6) 

i=l 

is globally asymptotically stable at x. It results from the discussion above, and in particular 
from Brockett's condition, that smooth or even continuous stabilizing feedbacks do not exist 
in general. This fact has generated a wide-ranging research with view to deriving adapted 
notions for stabilization issues, such as discontinuous piecewise analytic feedbacks (see [46 ), 
discontinuous sampling feedbacks (see [HI [37]), continuous time varying control laws (see [24]). 
patchy feedbacks (see [6]), almost globally asymptotically stabilizing feedbacks (see [38] enjoying 
different properties. The notion of smooth repulsive stabilizing feedback (see [39, 40, 4lJ), whose 
definition is recalled below, is under consideration in the present article. 

Let x € M be fixed. Let S be a closed subset of M and k — (fci, • • • , k m ) : M — > H m be a 
mapping on M. The feedback k is said to be smooth repulsive globally asymptotically stable at 
x with respect to S (denoted in short SRS 2; s) if the following properties are satisfied: 

(i) The mapping k is locally bounded on M and smooth on M \ S. 

(ii) The dynamical system ([6]) is globally asymptotically stable at x in the sense of Caratheodory. 
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(iii) For every x € M, the Caratheodory solutions of (J6|) satisfy x(t) ^ S, for every t > 0. 

We next associate to the control system ([5]) an optimal control problem. 

For xq € M and T > C0, a control u € L°°([0, T], H m ) is said admissible if the solution x(-) 
of (JSJ) associated to u and starting at xq is well defined on [0, T]. On the set U Xo ,t of admissible 
controls, and with the previous notations, define the end-point mapping by E XOi t{u) := x(T). 
It is classical that U Xo ,t is an open subset of L°°([0, T],H m ) and that E XQi t '■ Mx ,t —> M is a 
smooth map. 

A control u S U Xo ,t is said to be singular if m is a critical point of the end-point mapping 
E Xo ^p\ in this case the corresponding trajectory x(-) is said to be singular. 

Let xq and x\ be two points of M, and T > 0. Consider the optimal control problem of 
determining, among all the trajectories of (JU steering xo to x\, a trajectory minimizing the 
cost 

Cu(T,u)= [ u(t) T U(x{t))u(t)dt, (7) 
Jo 

where U takes values in the set of symmetric positive definite m x m matrices. 

Theorem 3. Assume that there exists a smooth function U : M — > such that no nontrivial 
singular trajectory of the control system (5p minimizes the cost Fty between its extremities. 
Then, there exist a mapping k : M — > M m , and a closed nonempty subset S of M , of HausdorfJ 
dimension lower than or equal to n — \, such that k is a SRS x .s feedback. 

Remark 1.8. The same remarks as those following Theorem [1] are valuable. In particular, it 
is proved in [TH] that, for a fixed smooth function U : M — > S+, if m > 3, then there exists 
an open and dense subset O m of the set of m-tuples of smooth vector fields on M so that 
the optimal control problem (JU-JU) defined with an m-tuple of O m does not admit nontrivial 
minimizing singular trajectories. 

2 Proof of the main results 

This section is organized as follows. In Section [27X1 we recall some tools of nonsmooth analysis 
that are required to prove our main results. Section 12.21 is devoted to the proof of Theorem 
[TJ We first define a Bolza problem, equivalent to the sub-Riemannian problem, for which we 
derive some fine properties of the value function and of optimal trajectories. In particular we 
prove that the value function is smooth outside a singular set which is defined using a specific 
notion of subdifferential. Theorem [T] is then derived in Section [2.2.41 Theorem [2] is proved in 
Section |2~3"1 The proof of Theorem [3] is similar to the one of Theorem [T] and thus is skipped. 

2.1 Preliminaries: some tools of nonsmooth analysis 

Let M be a smooth manifold of dimension n. 

2.1.1 Viscosity subsolutions, supersolutions and solutions 

For an introduction to viscosity solutions of Hamilton-Jacobi equations, we refer the reader to 
[3 [251 EH- Assume that F : T*M x R — > R is a continuous function on M. A function 
u : U — > 1R, continuous on the open set U C M, is a viscosity subsolution (resp., supersolution) 
on U of 

F(x,du(x),u(x)) = 0, (8) 

4 Note that, in what follows, the value of T is not important. It can be assumed for instance that T = 1. 
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if, for every C 1 function (j> : U — > R (resp., ip : U — > R) satisfying <f> > u (resp., ^ < 
w), and every point ij 6 [/ satisfying </>(xo) = u(xq) (resp., tp(xo) = u(xo)), there holds 
F(xo,d(j)(xo),u(xo)) < (resp., F(xq, dif)(xo) , u(xq)) < 0). A function is a viscosity solution of 
dHJ) if it is both a viscosity subsolution and a viscosity supersolution of ([8]). 

2.1.2 Generalized differentials 

Let u : U — > 1R be a continuous function on an open set £/ C M. The viscosity subdifferential 
of u at x G [/ is the subset of T*M defined by 

D~u(x) := {dip(x) | "0 G C 1 (L T ) and / — i\) attains a global minimum at x} . 

Similarly, the viscosity super differential of u at x is the subset of T*M defined by 

D + u(x) := {d<j)(x) | (f> G C 1 (J7) and f — <fi attains a global maximum at x} . 

Notice that u is a viscosity subsolution (resp., supersolution) of ([8|) if and only if, for every x € U 
and every ( e D + u{x) (resp., Q <E D~u(x)), one has F(x,C,w(x)) < (resp. ^(cc, £, u(x)) > 0). 
The limiting subdifferential of w at x G [/ is the subset of T*M defined by 

d L u(x) := < lim ( fc | ( k £ D~u(x k ),x k x 

I — ^CxD 

By construction, the graph of the limiting subdifferential is closed in T*M. Moreover, the 
function u is locally Lipschitzian on its domain if and only if the limiting subdifferential of u 
at any point is nonempty and its graph is locally bounded (see [22l [42] ). 

Let u : U — > 1R be a locally Lipschitzian function. The Clarke's generalized gradient of u at 
the point x e U is the subset of T*M defined by 

du{x) :— co {8lu{x)) , 

that is, the convex hull of the limiting differential of u at x. Notice that, for every x G U , 
D~u(x) C 8lu(x) C du(x) and D + u(x) C du(x). 

2.1.3 Locally semiconcave functions 

For an introduction to semiconcavity, we refer the reader to [15] . A function u : U — > R, 
defined on the open set U C M, is locally semiconcave on U, if for every x € t/, there exist a 
neighborhood C/ K of x and a smooth diffeomorphism ^ : U x — > (p x (U x ) C R" such that /o 
is locally semiconcave on the open subset i7 x = <p x (U x ) c R™. For the sake of completeness, 
we recall that the function w : [/ — > 1R, defined on the open set U C R", is locally semiconcave 
on U, if for every x £ U there exist C, 6 > such that 

Aiu(y) + (1 - /i)u(aj) - u(nx + (1 - /%) < /i(l - y)C\x - y\ 2 , (9) 

for all x, y G x + <5_B (where £? denotes the open unit ball in R") and every G [0, 1]. This is 
equivalent to say that the function u can be written locally as 

u(x) = (u{x) ~ C\x\ 2 ) + (C|x| 2 ) , Vx G x + SB, 

that is, as the sum of a concave function and a smooth function. Note that every semiconcave 
function is locally Lipschitzian on its domain, and thus, by Rademacher's Theorem, is differen- 
tiable almost everywhere on its domain. The following result will be useful in the proof of our 
theorems. 
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Lemma 2.1. Let u : U — > M be a function defined on an open set U C M n . If for every x S U , 
there exist a neighborhood V of x and a positive real number a such that, for every x £ V, there 
exists p x £ M n such that 

u(y) <u{x) + (p x ,y - x) + a\y - x\ 2 , (10) 
for every y £ V, then the function u is locally semiconcave on U . 

Proof. Without loss of generality, assume that V is an open ball B. Let x,y £ B and [i £ [0, 1]. 
The point x fix + (1 — fi)y belongs to B by convexity. By assumption, there exists p £ R" 
such that 

u(z) < u(x) + (p, z — x) + a\z — x\ 2 , Vz £ B. 

Hence, 

/J,u(y) + (1 — fi)u(x) < u(x) + fia\x — x\ + (1 — p)cr\y — x\ 2 

< u(x) + (/i(l - fi) 2 a + (1 - fj,)n 2 a) \x - y\ 2 

< u(x) + 2/i(l — p)a\x — y\ , 

and the conclusion follows. □ 

The converse result can be stated as follows. 

Proposition 4. Let U be an open and convex subset of M n and u : U — > 1R be a function which 
is C -semiconcave on U, that is, which satisfies 

fj,u(y) + (1 - (i)u(x) - u(p,x + (1 - p)y) < - fx)C\x - y\ 2 , (11) 

for every x,y £ U. Then, for every x £ U and every p £ D + u(x), we have 

C 

u{y)<u(x) + (p,y-x) + -\y-x\ 2 1 £ fl, (12) 
In particular, D + u(x) = du{x), for every x £ U . 

Remark 2.1. As a consequence (see [TSJ E2]), we obtain that, if a function u : U — > 1R is locally 
semiconcave on an open set U C M, then, for every x £ U, 



d L u(x) = < lim du(x k ) \ x k £ V u ,x k — > 

I k — *oo 

where V u denotes the set of points of U at which u is differentiable. 

The following result is useful to obtain several characterization of the singular set of a given 
locally semiconcave function. We refer the reader to [TSl H2] for its proof. 

Proposition 5. Let U be an open subset of M and u : U — > M be a function which is locally 
semiconcave on U . Then, for every x £ U , u is differentiable at x if and only if du(x) is a 
singleton. 

The next result will happen to be useful (see [TH Corollary 3.3.8]). 

Proposition 6. Let u : U — > 1R be a function defined on an open set U C M. If both functions 
u and —u are locally semiconcave on U , then u is of class C, ' on U . 
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2.1.4 Singular sets of semiconcave functions 

Let u : U — > R be a function which is locally semiconcave on the open set U C M. We recall 
that since such a function is locally Lipschitzian on U, its limiting subdifferential is always 
nonempty on U. We define the singular set of u as the subset of U 

E(ti) := {i £ (7 8lu(x) is not a singleton} . 

Alberti, Ambrosio and Cannarsa proved in [5] the following result 

Theorem 7. Let t/ be an open subset of M . The singular set of a locally semiconcave function 
u : U — ► 1R is of Hausdorff dimension lower than or equal to n — 1 . 

The following lemma, proved in Appendix (Section 13. ip . will be useful for the proof of 
Theorems Q] and [2j 

Lemma 2.2. Let u : U — > M be a locally semiconcave function on an open subset U C M and 
7 : [a, 6] — * U be a locally Lipschitzian curve on the interval [a,b]. Then, for every measurable 
map p : [a, b] — > T* M verifying 

p(t) G D + u(-f(t)), for a.e. t G [a, 6], 

we ftove 

-| (u(7(t))) = p(t) (7(t)) , for a.e. t G [a, ft]. 
2.2 Proof of Theorem ffl 

From now on, assume that the assumptions of Theorem [1] hold. In particular, assume that 
there exists no nontrivial singular minimizing path for the metric g. 

2.2.1 An equivalent optimal control problem 

Define the running cost L g by 

L g (x,v) := g x (v,v), 
for x £ M and v G A(z), and define the functional J ff : ^a(^) — * R + by 

J 9 ( 7 ) := f 1 L g ( 7 (t),j(t))dt. 
Jo 

The Bolza optimization problem under consideration, denoted by (BP) fl .A, consists in minimiz- 
ing the functional J g , called energy, over all horizontal paths 7 joining x to x G ill. Since M 
is connected and complete, and since the running cost L s is coercive in every fiber, for every 
x G M there exists a horizontal path 7 £ J7a(^,2;), minimizing the energy J g . The value 
function associated to the Bolza problem (BP) 9! a is defined by 

V g ,A(x) ■= inf {J g (l) I 7 € n A (x,a;)} , 

for every i e Af. 

Note that the length of a horizontal path 7, defined by j2]), does not depend on its parametriza- 
tion. Hence, up to reparametrizing, one can assume that the horizontal paths are parametrized 
by arc-length, i.e., that g-y(t)('j(t), 7(t)) = 1. In this case, the length minimizing problem is 

5 In fact, this result has been strengthened later as follows. We can prove that the singular set of a locally 
semiconcave function is countably n — 1-rectifiable, i.e., is contained in a countable union of locally Lipschitzian 
hypersurfaces of M (see 1151 142p . 
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equivalent to the minimal time problem. Moreover, if all paths are defined on the same inter- 
val, then length and energy minimization problems are equivalent, and the value function V gA 
satisfies 

V 9 ,a{x) = d S R{x,x) 2 . (13) 

In other terms, the sub-Riemannian problem of minimizing the length between two points x 
and x, for the sub-Riemannian manifold [M, A, g), is equivalent to the Bolza problem (BP) 9j a. 

We next provide another equivalent formulation of this optimization problem, in terms of 
optimal control theory, that will be useful in the proofs of Theorems Q] and [H Let x S M, and 
let 7 be a minimizing horizontal path joining x to x. Since 7 is necessarily not self-intersecting, 
there exists a tubular neighborhood V of the path 7 in M, and there exist to smooth vector 
fields /1, . . . , f m on V, such that 

A(x) = Span {^(3;) \i = l,...,m}, 

for every x e V. Then, every horizontal path x(-), contained in V, is solution of the control 
system 

m 
i=l 

where u(-) = (ui(-), . . . , u m (-)) £ L°°([0, 1]; M m ) is called the control. Without loss of generality, 
we assume that the m-tuple of vector fields (/1, . . . , f m ) is orthonormal for the metric g. In 
these conditions, the energy of the path x(-) is 

„i m 

Ja i=l 

Since the optimal control problem does not admit any nontrivial singular minimizing path, 
it follows from the Pontryagin maximum principle (see [35 ) that every minimizing path 7 
is the projection of a normal extremal ip(-) — ( / y(-),p(-)), associated with the control it(-) = 
(wi(-), . . . ,«m(-))i where 

u i (t) = (p(t),f i ( 1 (t))), i = l,...,m. (14) 



2.2.2 Properties of the value function V^ a 

Consider the Hamiltonian function H g ^ : T*M H defined by 

H g ,A( x 'P) : = m A a * \P( V ) ~ t;9x(v,v) 

ti6A(i) y z 

Note that this Hamiltonian coincides with the Hamiltonian H defined by ([3]) (as can be seen in 
local coordinates). 

Proposition 8. // the distribution A is nonholonomic on M, then the value function V^a : 
M —> M is continuous on M and is a viscosity solution of the Hamilton- J acobi equation 

-\v gA {x)+H gA (x,^dV g , A (xfj =0, VxeM\{x}. (15) 

Note that this proposition still holds if there exist some minimizing singular paths. 

Proof. The continuity of V gA follows from the continuity of the sub-Riemannian distance, 
associated to the metric g, on M x M . Notice that, since the running cost L g is coercive in 
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the fibers, and since M is connected, for every x G M \ {x}, there exists an horizontal path 
7(") G £Ia(x,x) such that 

V gA {x) = J g { 7 {-)) = / L g ( 7 (s),<y(s))ds. 

Let us prove that V 9i a is a viscosity solution of (p~5|) on M \ {x}. Let x G M \ {i}, and let 
7 : [0, 1] — > Af be an horizontal path joining a; to ir. For i € (0, 1), there exists 7 £ f2A(£>7(£)) 
such that 

^,a(7(*)) = J*LMs)Ms))ds = \f l< a (7 (|) .7(f)) da. 
Define 71 E f2A(x, x) by 



7i 



(s) .-i 7(f) if«€[0,t], 



Then, there holds 



rl 

Vjr.Afc) < / i 9 (71 (s), 7i (s))ds 



/ L g 





< \v gA {l{t))+ j L g ( 7 (s),j(s))ds. 
If : Af — » R is a C 1 function satisfying > V^.a and 4>(x) = V 9} a(x), then 

<t>(x)=V g , A (x) < jV gA (l(t)) + j L a b{8),i{8))da 

1 f 1 

< jHl(t))+ J L s ( 7 ( S ), 7 ( S ))rf S . 

Making i tend to 1, and considering all C 1 horizontal paths joining x to x, we infer that, for 
every v G A(x), 

d<j>(x)(v) < 4>{x) + L g (x, v). 

On the other part, consider some path 7 G Oa(x, s) satisfying V^a^) = J g (j)- For every 
i G (0, 1), up to a change of variable, this path is necessary minimizing between x and j(t). 
Therefore, for every t G (0, 1), 

^a(x) = \v gA (i(t))+ J L g ( 7 (s),j(s))ds. 
Hip ;U — > IR is a C 1 function satisfying t/> < V 9! a and 4>(x) = V 9i a(x), then 

1 r 1 

${x) > -V(7(*)) + _/ £ 9 (7(a),7(«))da. 

As previously, passing to the limit yields the existence of w G A(ar) such that 

dip(x)(v) > ip(x) + L g (x, v). 
The conclusion follows. □ 
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Remark 2.2. Notice that, since V gA is a viscosity solution of (fl~5|) on M\ {a;}, there holds, for 
every horizontal path 7 : [a, b] — > M \ {x} (with a < b), 

V g Mj(b))-V gA h(a))< [ V gA Ms))ds+ [ L g ( 7 (s),j(s))ds. 

J a J a 

Remark 2.3. We also notice, that since V 3 ,a is a viscosity solution of (fT5]l on M \ {x}, we have 

-\v gA (x) + H gA (x,~Q=0, VxeM\{x}, VC e d L V gA (x). (16) 

Finally we have the following result. 

Proposition 9. If the distribution A is nonholonomic on M , then the value function V g a is 
continuous on M , and locally semiconcave on M \ {x}. 

We just sketch the proof of Proposition |5J we refer the reader to [21131] for further details. 

Proof. Recall that since M is connected and complete, for every x £ M \ {x}, there exists an 
horizontal path 7 £ CIa(x,x) such that 

V 9 ,a(x) = J g (j) = / L g (j(s),j(s))ds. 
Jo 

By assumption, this minimizing path 7 is necessarily nonsingular, and thus, it is the projection 
of a normal extremal. It is well known (see [US?]) that, for every x £ M \ {x}, there exists a 
neighborhood V of x in M \ {x}, such that the set of cotangent vectors po £ Tj*M for which 
exp s (po) £ V and the projection of the corresponding normal extremal minimizes the length 
between x and exp s (po), is compact in T%M. On the other hand, we know from [431 Proposition 
4 p. 153], that, if £ £ di,V gt A(x), then there exists a normal extremal ip : [0, 1] — > T*M whose 
projection is minimizing between x and x and such that tp(l) — (x, This proves that the 
function V gA is locally Lipschitzian on M \ {x}. 

Let x £ M \ {x}, and let 7 be a minimizing horizontal path joining x to x. By assumption, 
this path is nonsingular, and thus, it is not a critical point of the end-point mapping Ex- Hence, 
there exists a submanifold N of VLa{x), of dimension n, such that the mapping 

£ : N — ► M 
7 (-) ^ S 4 ( 7 (0)=7(l) s 

is a local diffeomorphism, from a neighborhood of 7(0 in N, into a neighborhood VV of x = 7(1). 
We infer that, for every y £ W, 

V g ,A{y) < J g {£-\y)). 

Since J g is smooth on the submanifold N, up to diffeomorphism, one can put a parabola over 
the graph of J g on N, and thus, over the graph of the function V gA at every x £ M\ {x}. The 
second-order term of this parabola depends on the minimizing controls which are associated to 
the points x. Using the compactness of the minimizers that we recalled above, we deduce that 
the function V gA is locally semiconcave on M \ {x}. □ 

In the sequel, the singular set of V 9: a, denoted T,(V gA ), is 

£(K?,a) := {x £ M \ {x} I di,Vg j A{x) is not a singleton} . 

Recall that, since the function V^.a is locally semiconcave on M\{x}, its limiting subdifferential 
is nonempty at any point of M \ {x} (see |15j). 
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2.2.3 Properties of optimal trajectories of (BP) 9j a 

We stress that, due to the assumption of the absence of singular minimizing path, every minimiz- 
ing curve of the Bolza problem (BP) A is the projection of a normal extremal, i.e., an integral 

curve of the Bamiltonian vector field H defined by ([3]), associated with H. In particular, every 
minimizing curve of (BP) A is smooth on [0, 1]. 

Lemma 2.3. For every x € M \ {x} and every £ G 9lVq,a( x )> there exists a unique normal 
extremal tp(-) : [0, 1] — > T*M whose projection j(-) : [0, 1] — > M is minimizing between x and 
x, and such that ip(l) — (x, i£) in local coordinates. In addition, is the unique (up to a 

multiplying scalar) normal extremal lift of 7(-). 

Proof. The first part of the statement is a consequence of [131 Proposition 4 p. 153]. Uniqueness 
follows from Cauchy-Lipschitz Theorem. Uniqueness (up to a multiplying scalar) of the normal 
extremal lift of 7(-) is a consequence of the assumption of the absence of singular minimizing 
paths (see @S Remark 8 p. 149]). □ 

Lemma 2.4. Let x S M \ {x} and 7(-) : [0, 1] —* M be a minimizing curve of {BP) gJ \ such 
that 7(1) = x. Then, for every t G (0, 1), the curve 7*(-) : [0, 1] — » M defined by 7 (s) := 7(st), 
for s € [0, 1], is the unique minimizing curve of (BP) g ^ steering x to 7(i). Moreover, 7 (•) is 
the projection of the normal extremal (7 (OjPv')) ^ n i°cal coordinates, withp l {s) — tp(st) for 
every s £ [0, 1] . 

Proof. We argue by contradiction. If there is another horizontal curve 72G) : [0, 1] — » M which 
minimizes the sub-Riemannian distance between x and j(t), then there exists a nontrivial 
minimizing path x(-), joining the points ^(t) and 7(1) = x, and having two distinct normal 
extremal lifts V-'i(') an d V^G)- Then, the extremal ipi(-) — V^O) is an abnormal extremal lift 
of the path x(-). Bence, the path x(-) is singular and minimizing, and this contradicts our 
assumption. 

We next prove that the adjoint vector associated to 7*(-) is given by p t (s) = tp(st) for 
s e [0, 1]. In local coordinates, using the expression (fT4]) of normal controls, 7(-) is solution of 
the system 

n 

i(t) = £<p(*),/i(7(*))>/i(7(*)), for a.e. * € [0,1]. 

i=l 

Bence, 7*(-) is solution of 

rl ™ 

j- s 7 t (s)=tJ2(j>(st),fi(l t m)m t (t)), for a.e. se [0,1]. 

i— 1 

The conclusion follows. □ 

Lemma 2.5. Any normal extremal : [0, 1] — > T*M whose projection is minimizing between 
x and igM \ {x} satisfies £ € di,Vg,A[x) , where "0(1) = (x, ^C) i n local coordinates. 

Proof. Let ip(-) : [0,1] — > T*M be a normal extremal whose projection 7(-) is minimizing 
between x and x G M \ {x}. Since V g _A is locally semiconcave on M \ {x}, its limiting 
subdifferential is always nonempty on M \ {x}. We infer from Lemmas 12.31 and 12.41 that, 
for every t € (0,1), there holds d L V gA {l{t)) = {({t)}, where ip(t) = {x(t),±((t)) in local 
coordinates. Consider a sequence (tk) of real numbers converging to 1. Then, on the one part, 
the sequence (ip(tk)) converges to ^(1), and on the other part, by construction of the limiting 
subdifferential, ( = C(l) € d L V gA {x). □ 
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Lemma 2.6. The following inclusion holds: 



£(^ lA ) \ E(V*a) c C mm {x)U{x}. 

In particular, the set E(V^a) is of Hausdorff dimension lower than or equal to n — 1. 

Proof. Let x G S(V 9i a)\S(VJ ?i a) such that x ^ x. By definition, the set c^V^a^) is a singleton. 
Hence by Lemmas 12.31 and 12. 51 there is a unique minimizing path 7(-) S J1a(S2;) and a unique 
normal extremal V'(') : [0,1] — > T*M such that 7(-) = 7r(?/>(-)); moreover, d^V^A^) = {C}i 
where V'(l) = (x, |C) m local coordinates. We argue by contradiction; if x £ C m i n (x), then 
the exponential mapping exp s is not singular at po, where ipiG) = (^>Po) i n local coordinates. 
Furthermore, since x G £(V^a), there is a sequence of points (xk) in £(V^a) which converges 
to x. For every fc, the set dLV g ,A{%k) admits at least two elements. Hence for every fc, there are 
two distinct normal extremals ipl(-), ipl(') '■ [®> 1] ~* T 1 *-^ such that their projections 7^(-)j 7f (') 
are minimizing between 5 and Xk- Since the limiting subdifferential of V 3t A is a singleton, the 
sequences (ipl(l)), (ipl(l j) converge necessarily to ip(l). Moreover, by regularity of the Hamil- 
tonian flow, the sequences (^(O)), (^(0)) converge necessarily to t/)(Q). But the exponential 
mapping exp 2 must be a local diffeomorphism from a neighborhood of po into a neighborhood 
of 7r(V>(l))- This is a contradiction. The second part of the lemma follows from the fact that 
the singular set S(V^a) is of Hausdorff dimension lower than or equal to n — 1 (see Theorem 
[7]), and of the fact that the set C m i n (x) is contained in C{x) which is of Hausdorff dimension 
lower than or equal to n — 1 (by [551 Theorem 3.4.3]). □ 

Lemma 2.7. The function V 3t A is of class C 1 on the open set M \ ^E(V^a) U {^}) • 

Proof. The set di,Vg^{x) is a singleton for every x in the set M \ ^E(V^a) U {x}j which is 
open in M. From Remark 1 2. II and the fact that u is differentiable at some x € M \ {x} if and 
only if x ^ S(tt), we infer that V 9 .a is of class C 1 on the set M \ ^S(V S! a) U {a;}^- □ 

Lemma 2.8. Let x S M \ {x} and j(-) : [0, 1] — > M be a minimizing curve of (BP) 9 a such 
that 7(1) = x. Let U x be an open neighborhood of x and <p x : U x — > (p x (U x ) C 1R" be a 
smooth diffeomorphism such that V := V 9 .a 1 is a locally semiconcave on the open subset 
U := Lp x {Ux) C St . Let t G (0, 1) be such that j(s) G U x for every s G [t, 1]. Then there exist 
a neighborhood Wt ofj(t) and o~(t) > such that 

V(y) > V(Ml(t))) + dV(ip x m)))(y - ^ x (j(t))) - a(t)\y - ^(7(*))| 2 , Vy G W t . (17) 

Proof. Without loss of generality, we assume that M — H™ , that cp x is the identity, and that 
the closure of U x is a compact subset of M \ {x}. Set x s :— j(s), for every s G [t, 1]. Since 
V = Vg^A is locally semiconcave on M \ {x}, there exists a G 1R such that 

V(y)<V(x s )+dV(x s )(y-x s )+a\y-x s \ 2 , Vy G U, Vae[t,l]. (18) 

The horizontal path ^(-) : [0, 1 - t] -> M, defined by 

7(s) := 7(1 - s), Vsg[0, l-t], 

is minimizing between x and j(t). Hence, by assumption, it is nonsingular, and thus, it is not 
a critical point of the end-point mapping 

Et : n A (x) — ► M 

7 (.) .— > 7(1"*)- 
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Therefore, there exists a submanifold N of Qa {%) of dimension n, such that the mapping 

£ t :N — ► M 
7 (.) — £( 7 «), 

is a local diffeomorphism, from a neighborhood of 7 (-) in N, into a neighborhood Wj of 7(1— i) = 
x t . From Remark 12. 2i we infer that, for every y £ Wt, 

> - J V ( 7y ( a )) - | L 9 ( 7y («) s 7»(*)) ^> (19) 

where : [f, 1] — > M is defined by 

7 !/ ( S ):=£ t - 1 (y)(l- S ) ) Vae[t,l]. 

By ([TH]), we have 

V (j y (s)) ds > - J (V{x s ) + dV(x s )(j y (s) - x s ) + a\j y {s) - x s \ 2 ) ds. (20) 
Moreover, since 7 (-) is minimizing between x and x, 

V{x)=V{x t )+ [ V{x s )ds+ f L g (x s ,tf(s))ds. 



Hence, from flT8J), (jTQj) and l(20]), we deduce that, for every y e W t , 

%)>%) + $(»), 

where 



®(y) : = y (^fl(a: a) 7(s)) ^ L a (ly{s),iy(s)))ds- (dV(x s )(j y (s) - x s ) + a\j y (s) - x s \ 2 ) ds. 

Since the mapping $ t : W — * H is smooth and since &t(xt) — 0, a parabola can be put under 
the graph of V at Xt- This proves (fT7|) . □ 

Lemma 2.9. 27ie following inclusion holds: 



(x) c £(V 9i a). 

Proof. Let a; G C TOJ ;„(a;); note that, by definition of C m i n (x), one has x ^ x . We argue by 
contradiction. If x does not belong to S(V 9i a), then V gj A is C 1 in a neighborhood of x. This 
means that there exist a neighborhood V of £ and t £ (0, 1) such that for every y £ V, there is a 
minimizing curve of (BP) 9i a such that j(t) — y. From the previous lemma and by compactness 
of the minimizers, we deduce that the function — V 9i a is locally semiconcave on V. Hence by 
Proposition [6l V^a is C Jt J c in V. Define 

* : V — ► T|M 
y .— > V(0), 

where -0(-) : [0, 1] — > TM is the normal extremal satisfying V'(l) = {v, ^dV g .A{y))- This mapping 
is locally Lipschitz on V. Moreover by construction, 'J is an inverse of the exponential mapping. 
This proves that po '■= ^(x) is not a conjugate point. We obtain a contradiction. □ 

Lemma 2.10. Let po £ T?M be such that H(x,po) ^ 0. There exist a neighborhood W of po 
in T^M and e > such that every normal extremal so that tp(0) = (x,p) (in local coordinates) 
belongs to W is minimizing on the interval [0, e]. 
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The proof of Lemma fe.lOl is postponed to the Appendix (Section I3.2p . 

We are now ready to provide a proof for Lemma ll.ll 
Proof of Lemma li.il For the sake of simplicity, we assume that M — R n , endowed with the 
Euclidean metric. We have to prove that C m i n (x) C C(x). Let y £ C m i n (x). We argue 
by contradiction. Assume that y does not belong to C(x). This means that there exists a 
minimizing curve 7(-) of (BP) 9j a and t y G (0, 1) such that j{t y ) — y. Set x :— 7(1), and let i 
be the minimum of times t G (0, 1) such that 7(i) ^ £(V 9! a)- We claim that i G (0, t y \. As a 
matter of fact, we know by Lemma [231 that j(t y ) = y G S(V S! a)- Moreover, from Lemma [2.101 
and the absence of (nontrivial) singular minimizing path, the mapping 

W — ► M 
p 1 — ► n(ip{e)), 

where ip(0) = (x,p), is injective. Hence from the Invariance of Domain Theorerrjfl, this mapping 
is open. Which means that V — V 9 .a is necessarily of class C 1 on a neighborhood of each j(s) 
with s G (0, e]. We conclude that i G (0, t y \. 

Set x := 7(f) and x s := 7(3) for every s G [0, 1]. By local semiconcavity of V (see Proposition 
[9|) , there exists a neighborhood V of x in M \ {x} and a G R. such that 

VV) < + (dV(z),z' - z) + a\z' - z\ 2 , Vz, z' G V. (21) 

Let p £ T'M such that a; = exp s (p). Since V is of class C 1 in a neighborhood of the curve 
s G (0, t) 1 ► 7(s), there exists a neighborhood W' of p in T^M such that 

Vp G W, H(x,p) = H{x,p) F(exp s (p)) = V(s). 

Thus, by ([2T|) . we have for every p G W satisfying H{x,p) = H(x,p), 

(dF(2),exp s (p) - 5) > -ct |ex Ps (p) - x| 2 . (22) 

Furthermore, from Lemma l2.5[ there exist a neighborhood V of S and a' > such that 

V(z) > + (dV{x,z-x) - ct'|z-.t| 2 , VzgV. (23) 

Without loss of generality, assume that V" = V and a' = a. For every p G W", set .x(p) := 
exp s (p). By (|22|) and (|23| . we deduce that for every p G W" satisfying H(x,p) = H(x,p) and 
for every z G V, we have 

V(«) > y(i) + (dF(x),z-a;(p)) + (dV(x),x(p) - x) - a\z - x\ 2 
> V(x) + (dV(x), z - x(p)) - <r\x(p) - x\ 2 - a\z - x\ 2 . 

In conclusion, by (f2Tj) . we obtain that for every p G W" satisfying H(x,p) — H(x,p) and every 
z G V, we have 

(dV(i&),z- af(p)) - <r|ac(p) - x\ 2 - a\z - x\ 2 < (dV(x(p)),z - x{p)) + a\z - x(p)\ 2 . 
Hence, for every p G W satisfying H(x,p) = H(x,p) and every z G V, 

2cr|z - x{p)\ 2 + (dV(x(p)) - dV(x),z ~ x(p)} + 2a(x(p) -x,z- x(p)) + 2a\x(p) - x\ 2 > 0. (24) 

Now, since x — j(t) belongs to Y,(V), we know by Lemma 12.61 that the exponential mapping is 
singular at p. Define the mapping $ : H n x R n — > R n x R™ by 

V(z,p) G R" x R", $(x,p) := tP(x(l),p(l)), 

6 The Invariance of Domain Theorem states that, for a topological manifold N, if / : N — > N is continuous 
and injective, then it is open. We refer the reader to the book 1 1 2| for a proof of that result. 
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where (#(•), £>(•)) : [0,1] — > T*M is the normal extremal satisfying (x(0),p(0)) = (x,p). Since 
$ is a flow, its differential is always invertible. Hence there exist P £ R™ and Q € H™ \ {0} 
such that 

£>*(x,p)-(0,P) = (0,Q). 

This means that there exist two continuous functions ei,£2 : H — > R n , and a mapping A i— > 
p(A) G W' such that, for every A sufficiently small, the following properties are satisfied: 

(i) H(x,p(X)) = H(x,p); 

(ii) V{x\) = V(x) where x\ := x(p(X))\ 

(iii) x\ — x + A 2 ei(A); 

(iv) dV(x\) = dV(x) + XQ + A 2 e 2 (A). 
From ([24]) . we deduce that, for every z E V, 

2ct|z - a; A | 2 + A(Q, z - x A > + A 2 (e 2 (A), z - x x ) + 2aX 2 (e 1 {X),z - x x ) + 2aA 4 |ei(A)| 2 > 0. 
We can apply this inequality for every a sufficiently small with z = x\ — aQ. This yields 

2aa 2 \Q\ 2 - \a\Q\ 2 + A 2 a(e 2 (A), -Q) + 2a\ 2 a(e 1 (\), -Q) + 2(jA 4 |ei(A)| 2 > 0, 
for every A, a sufficiently small. Taking a :— A\/A, we find a contradiction. □ 
Lemma 2.11. There holds 

Z(V gA )=£(x)U{x}. 

In particular, the cut locus is closed in M \ {x}, and is of Hausdorff dimension lower than or 
equal to n — 1. 

Proof. From Lemma |2.3[ any point of £(V^a) is joined from x by several minimizing curves. 
Hence, from Lemma 12.41 any such point belongs to the cut locus C{x). From Lemmas 12.61 and 
11.11 we deduce that 

£(V s ,a) C C(x) U {x}. 

If x e M \ {x} does not belong to E(V^a), then, from Lemma [2~71 the function V^a is of class 
C 1 in a neighborhood U of x. Then, the continuous mapping 

F : U — > T*M 

x i * F{x)=-H{x,±dV gA {x)) 

is such that F(x) — (x,po), with exp 2 (po) = %■ This means that the exponential mapping exp 2 
is a homeomorphism from F(U) into U , of inverse mapping exp 2 . In particular, it follows that 
x C(x). The fact that x, belongs to S(V g! A) results from [TJ Theorem 1]. □ 

Remark 2.4. Lemma 12.111 asserts that the cut locus C(x) has Hausdorff dimension lower than 
or equal to n — 1. Recently, proving a Lipschitz regularity property of the distance function to 
the cut locus, Li and Nirenberg showed in [30] that the (n — l)-dimensional Hausdorff measure 
of the cut locus in the Riemannian framework is finite. It would be interesting to study the 
regularity of the distance function to the cut locus to obtain such a result in the sub- Riemannian 
case. 

Lemma 2.12. The function V g .A is of class C°° on the open set M \ ^(V^a)- Moreover, if 
7 : [0, 1] — > M is a minimizing curve for (BP) A , then j(t) ^ E(V 9! a); for every t £ (0, 1). 
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Proof. Let 7 : [0, 1] — ► M be a minimizing curve for (BP) A . It follows from Lemmas 11.11 and 
mUthat j(t) £ S(F SiA ), for every t € (0, 1). 

Let x € M \ S(V^.a), an d let 7(') be a minimizing horizontal path joining x to x. By 
assumption, 7(-) is necessarily nonsingular, and admits a unique normal extremal lift ip{-) : 
[0, 1] — > T*M. From Lemmas 11.11 and 12.111 the point x is not conjugate to x, and hence, the 
exponential mapping exp 2 is a (smooth) local diffeomorphism from a neighborhood of po into 
a neighborhood of x, where "0(0) = (x,po) i n local coordinates. As recalled in the first section, 
the length of the path 7(-) = is equal to (2 H(ip(Q))y/ 2 . Since 7(-) is minimizing, it is 

also equal to oIsr{x,x). Then, using local coordinates, and from (|13p . there holds 

V gA {x) = 2H{x,{exp s )- 1 (x)), 

in a neighborhood of x (see also [UJ Corollary 1 p. 157]). It follows that V^a is of class C°° at 
the point x. □ 



2.2.4 Conclusion: proof of Theorem [T] 

Define S := X(Vg.A). From Lemma \2. Ill there holds S — C(x) U {x}. We next define a section 
X of A, that is smooth outside S. To this aim, it is convenient to consider local coordinates, 
and to express the problem in terms of optimal control. Let x £ M \S. In a neighborhood U 
of x, one has, in local coordinates, 

A = Span{/i, . . . , f m }, 

where (/1, . . . , f m ) is a m-tuple of smooth vector fields which is orthonormal for the metric g. 
We proceed as in [37] . 

Let x £ M \ x be fixed (of course, we set X(x) := if x = x), pick some ( G d^Vg^x). 
Note that, since V 9i a is smooth outside the set S, one has C, = dV gt \{x) whenever x € M \ S. 
Define the control u(x) — (ui(x), • • • , u m (x)) by 

Ui(x) := \Q{h(x)), V* = l,-..,m. (25) 

For a; G M \ S, Ui(x) = \{dV gA (x), fi(x)) is the closed-loop form of the optimal control (|T4|) . 
For ie5, the expression of Ui(x) depends on the choice of £ € diy gA {x). Define 

m 

X{x):=-Y,Ui{x)fi{x). (26) 

i=l 

Geometrically, X(x) coincides with the projection of — jQ onto A(x). At the point x, we set 
X{x) = 0. This defines a vector field X on M, which is smooth on M \ S, but may be totally 
discontinuous on S. 

We next prove that X is SRSg.s. Property (i) is obviously satisfied, but properties (ii) and 
(iii) are not so direct to derive. 

We first prove that every minimizing trajectory yields a Caratheodory solution of x — X{x). 
Let x € M\x be fixed and 7(-) : [0, 1] — > M be a minimizing curve of the Bolza problem (BP) 9i a 
between x and x. It follows from the Pontryagin maximum principle that 7 is the projection 
of a normal extremal expressed in local coordinates by ip(') — (t(') > P(')) ■ Let t € (0, 1); from 
Lemma \2A\ the curve 7*(-) : [0, 1] — > M defined by 7*(s) := 7(si), for s 6 [0, 1], is the unique 
minimizing curve of (BP) 9 .a steering x to "f(t). Moreover, from Lemma l2.4( it is the projection 
of the normal extremal "0*(-) = ("J* (■) , P l (■)) , where p*(-) is defined by p t (s) — tp(st), for every 
s £ [0, 1]. It then follows from Lemmas 12.51 and 12. 121 that, along the curve 7(-), 

dV gA (j(t))=2tp(t), Vie (0,1). 
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Therefore, is solution of 
1 m 

= Y t T,{ dV aMl(t)KMl(t)))Ml(t)), a.e. on (0,1), 

i=i 

in local coordinates along 7(-). This implies that the curve x(-) : [0, oo) — > M defined by 

x(t) := 7 (e- 1 ) , VtG(0,oo), 

is a Caratheodory solution of x — X(x) such that x(0) = 7(1) = x. 

We next prove that any Caratheodory solution of x = X(x), x(0) = x, tends to x as t tends 
to +00. Having in mind the minimizing properties (by construction) of the vector field X, it 
suffices actually to prove the following lemma. 

Lemma 2.13. Let x(-) be any Caratheodory solution of x = X(x). Then, there does not exist 
a nontrivial interval [a, b] such that x(t) £ iS for every t G [a, b]. 

Proof. The proof goes by contradiction. Assume that there exist e > and a curve x(-) : 
[0, e] -> M such that 

x(t) = X(x(t)), for almost every t £ [0, e], 

and 

x(t)eS, Vte[0,e\. 
In local coordinates in a neighborhood of x(0) = x, one has 

x(t) = X{x{t)) = -TjSCi (fi(x(t)) fi(x(t)), for almost every t G [0,e], 

i=l 

where £t G 9j,Vg aC^C^)) f° r almost every t £ [0, e]. At this stage, we need to use Lemma [2.21 
whose proof is provided in Appendix (Section l3.ip . According to this lemma, using (|25|) and the 
Hamilton- Jacobi equation (fTB)) satisfied by V gA (see Remark l2.3p . we deduce that, for almost 
every t £ [0, e], 



d_ 

dt 



(V gA (x(t))) = Ct (x(t)) = -i ]T (C t (/ 4 (x(t)))) 2 = -ff 9 ,A(xW,C t ) = -2^,a(z(*)), (27) 

i=l 

since the Hamiltonian function H gA (x,p) is quadratic in p. Therefore, 

V gA (x(t)) = V gA {x)e- 2 \ Vf G [Q,e]. (28) 

Let 7(-) — > Af be a minimizing curve of the Bolza problem (BP) 9! a between x and x(e). Define 
the horizontal path 7(-) : [0, 1] — ► M by 



l(t) 



x(-\nt) if e~ e < t < 1 
7 (e £ i) if 0<£<e~ £ . 



The cost of 7(-) is 



Uli-)) = I L g (i(t)Mt))dt+ I L 9 (l(t),l(t))dt 



L g ( 1 (eH),e e j(eH))dt + J L g (j(t),j(t)) dt 

e e V gA (x(e)) + / ^ti t {x{-\nt)) 2 dt 
Je ~" 1 1=1 

re rn 

e e V gA (x(e)) + / e s J2Mx(s)) 2 ds. 
Jo i=i 
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Using (f25l) . (f27|) . and (f28|) . one has, for almost every s £ [0, e], 

m m ^ 2 

E^(^ s )) 2 = Ei(& (/*(*(*)))) = ^.aW s » = v 9 a*>- 2s , 

i=X i=l 

and, since V gA {x(t) = V gA (x)e~ 2lL , it follows that 

j g m) = v gA { X ). 

Hence, 7 is a minimizing curve of the Bolza problem (BP) 9i A between x and x. From Lemma 
12.121 it cannot stay on S on positive times. This yields a contradiction. □ 

It follows from this lemma, and from the construction of X using optimal controls, that any 
Caratheodory trajectory of x = X(x), x(0) = x, tends to x as t tends to +00. The property of 
Lyapunov stability is obvious to verify. Finally, the fact that the set S has Hausdorff dimension 
lower than or equal to n — 1 is a consequence of Lemma 12.61 



2.3 Proof of Theorem [2] 

Let g be a Riemannian metric on M and x be fixed. Since A is a smooth distribution of rank 
two on M, for every x £ M, there exists a neighborhood V x of x and two smooth vector fields 
fx > fi which represent A in V x , that is, such that 

A(y) = Span{/f (y)J^y)} , Vy e V x . 

Moreover, as recalled in the introduction, since A is a Martinet distribution, for every x £ Ea, 
the two vector fields /f , /f can be chosen as 

^ = ^ + ^ and r ^h (29) 

in local coordinates. Recall that, in the neighborhood V x , the Martinet surface Ea coincides 
with the surface x-i = 0, and the singular paths are the integral curves of the vector field 
restricted to x 2 = 0. For convenience, consider that the vector fields /f , /f are defined as well 
outside the neigborhood V x . Thus, without loss of generality, for every x £ M, we assume that 
the vector fields /f , /f are well defined, smooth on M and satisfy 

fx (y) = (v) = 0, VyeM\W x , 

with V x C yV x , and 

Span {/f (y), fi(y)} C A(y), Vy e M. 
By compactness of Ea, there is a finite number of points (xi)ig/ of Ea such that 

Ea C U ie iV Xi . 

Let P : M — > [0, 00) be a smooth function such that 

VieM, P(x) = x G Ea- 

For every i £ I, define the smooth vector field gi, in local coordinates, by 

9i(y) :=/%)/?%), VyeM. 
By compactness of M, there is a finite number of points of M such that 

M C (UigiVx,) U (L> je jV yj ) 
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and 

s A n (u jeJ w yj ) =0. 

By construction, we have 

Span {ftd,), /!'(»), /«(!/), /^(i/) \i€l,j€ J}=A(y), Vy G M \ S A (30) 

and 

Span{ 5i (y),/ 2 x *(2/),/i I ' J (j/),/ 2 % (j/) | i€7,je J}nT y E A = {0}, Vy e E A . (31) 
Indeed, for every y G E A , there holds 

Sp^{g l (y)J^(y),f y 1 '(y)J^(y) \ieI,jeJ} = Span{/f%) | i G 7} . (32) 

It follows from (|30j) and (f3Tj) that any trajectory, solution of the control system 

i(t) - $>K*)<?*(z(*)) +^(«)/? 4 (»(*)) + X>] (*)A W (*(*)) +v%t)fV{x{t)), (33) 
iG-T jeJ 

where u(-) = (ttj(-), " * ' > '"fn (") ' '"f J| (*) » v i 0) j u ? (") ^ " * • ) w jj|(-)><fj|(\)) belongs to the con- 
trol set W defined by 

is an horizontal path of A. Note that, for every u(-) G U, there exists a unique absolutely 
continuous curve J u (-) '■ [Pi 1] ~~ * such that 7„(.)(0) = x and 

M-)® = E K(*)ft(7«(.)(*)) +«f(*)/f < (7«(.)(*))) 

+ E («j(*)/i J (7«(.)(*)) +«|(*)/2 % (7«(.)(*))) . 

for almost every f G [0, 1]. Moreover, it is clear by construction of the control system under 
consideration that, for every x G M, there exists a control it(-) G U such that 7„(.)(1) = x. For 
every u(-) G U, set 

W)) := r |E K-(*) a +«?(*) 2 ) +E («i(*) 2 + «i(*) 3 ) i *• 

Define the value function W : M — > ]R by 

W^x) :=inf{j(u(.)) | u(-)6W, 7u( .)(Q)=2, 7„ ( .)(1) = a:} , 

for every a; G M. By coercivity of the cost function, it is easy to prove that, for every x G 
M \ {x}, there exists a control u(-) G U such that 7-u(.)(l) = x and W(x) = J(it(-)) (i.e., a 
minimizing control). Moreover, by construction of the control system, more precisely, from (|32|). 
the trajectory 7 U (.) (•) cannot stay on the Martinet surface on a nontrivial subinterval of [0, 1] . As 
a consequence, since any singular trajectory is contained in the Martinet surface, any nontrivial 
minimizing control is nonsingular. Using similar arguments as in the proof of Theorem [TJ it 
follows that the value function W is a viscosity solution of a certain Hamilton- Jacobi equation, 
is continuous on M, and is locally semiconcave in M \ {x} (see [33]). Moreover, the optimal 
trajectories of the optimal control problem under consideration share the same properties as 
those of the Bolza problem (BP) SiA . The construction of a stabilizing feedback then follows 
the same lines as in Theorem [TJ 

Remark 2.5. For a noncompact manifold M, the above proof needs to be adapted by replacing 
a finite number of controls (iti)ie/ and (uj)ieJ with a locally finite set of controls. 
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3 Appendix 



3.1 Proof of Lemma EO 

Without loss of generality, we assume that M — R". Given k £ {1, ••■ , n} and p > 0, denote 
by the set of all x £ U such that D + u(x) contains a fc-dimensional sphere of radius p, 

and define 

S fe (u) := {x £ U | dim (L>+u(.t)) = A:} . 

By well known properties of convex sets, one has £ fc (u) C U p>0 £jo(u). Note that a point 
x £ T, (u) does not necessarily belong to T, k (u), since D + u(x) may be of dimension greater 
than k. The following result is fundamental for the proof of Lemma 12.21 (we refer the reader to 
[15] for its proof). 

Lemma 3.1. For every k £ {1, • • • ,n} and every p > 0, the set is closed and satisfies 

T&n(x,X k p (u)) C [D + u(x)] X , Vx £ X k p (u) n S fe (ufl 

Return to the proof of Lemma [2.21 First, note that the map t £ [a,b] i— ► u(7(t)) is Lip- 
schitzian. Hence, by Rademacher's Theorem, it is differentiable almost everywhere on [a, b\. 
Moreover, by the chain rule for Clarke's generalized gradients (see [22]), for every t £ [a,b] 
where 7 is differentiable, there exists p £ du(-f(t)) such that 

|(«(7(*))) = <P,7(*)>. (34) 
For every k £ {1, • • • ,n} and any positive integer I, set 

h,i ■= {t£[a,b} I 7 (t) e (E|( w )ns fc (u)) 

and 

J:= [a,b]\\Jl kil . 

k,l 

Notice that, since u is locally semiconcave and 7 is locally Lipschitzian, u is differentiable at 
almost every 7(f) with t £ J. Thus, for every such t, there holds necessarily p(t) = Vit(7(t)) 
and 

|(«(7(*))) = <P(*),7(*)>. 

It remains to prove that this equality holds for almost every < in [a,b] \ J. From the Lebesgue 
density theorem, there exists a sequence of measurables sets {I' k ; } such that all sets Ik.i \ I' k t 
have Lebesgue measure zero and such that any point in one of the sets I' k l is a density point 
in that set. It is sufficient to prove the required equality on each set I' k ,. Fix k, I and t £ I' k t , 
set x := 7(i). Since a; is a density point in I' kl , there exists a sequence {ti\ of times in I' kl 
converging to t. Thus, the vector 7(4) belongs to Tan (x, Then, from Lemma [3~T1 ^(t) 

belongs to [D + u(x)] ± . By p4|) . we obtain the desired equality. This concludes the proof of 
Lemma 12.21 

7 Here, Tan [x, Ep(w)) denotes the tangent set to T,p(u) at x. Recall that, given a closed set S C R™ and 
x £ S, the tangent set to S at 2, denoted by Tan(a;, S), is defined as the vector space generated by the set 

T(x, S) := \ lim Xl ~ x Xi g g, x t -* x, U g R+ , U { \ . 

Recall also that, if A C R n , then the set A 1 - is defined as the set of vectors v G R n such that (v,p) = (v,p') 
for any p,p' £ A. 
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3.2 Proof of Lemma I2TT01 

The proof that we present here is taken from [32] (compare with [32] 133] )• For the sake of 
simplicity, assume that M = K", endowed with the Euclidean metric. Since the property to be 
proved is local, we assume that there are m smooth vector fields /i, • • • , f m , orthonormal with 
respect to the Euclidean metric, such that 

A(x) = Span{f % (x) | i = 1, ...,m}, 

in a neighborhood V of x. With these notations, the associated Hamiltonian H : H" x H" — » H 
is 

^ m -| m ^ -| m 



{in 1 771 1 1 771 

i=l i=l J i=l 



for every (x,p) € i?" x R n . 

Our aim is now to prove the following result: for every po S M™ such that H(x,po) ^ 0, there 
exist a neighborhood W of po in IR™ and e > such that every solution (#(•), p(-)) : [0, e] — > 
IR" x IR" of the Hamiltonian system 



X (t) = ^-{x{t), P {t)) = Y,WlfMt)))fMt)) 



8H m 



(35) 



(36) 



dp 


dx 

with x(0) = x and p(0) E W, satisfies 

/ $>(i),/^(*))} 2 ^< / 5>(i) 2 ^ 
i=l Jo 4=1 

for every control u(-) G L°°([0, e]; H m ) such that the solution of 

m 

= X>(*)/i(y(*))> y(0)=S, (37) 
i=i 

satisfies y(e) = x(e). Let po G \ {0} be fixed, we need the following lemma. 

Lemma 3.2. There exist a neighborhood W of p$ and p > such that, for every p S W, f/iere 
exists a function S : B(x,p) — > J?? o/ dass C 1 which satisfies 

H(x,VS(x)) = H(x,p), Vi€B(i,/)), (38) 

and smc/i i/ia£, (^(-^p^-)) denotes the solution of \35)) satisfying x p (0) = x and p p (0) = p, 
then 

VS(xV(t))=pt>(t), Vie(-p,p). (39) 

Proof. The proof consists in applying the method of characteristics. Let LI be the linear hy- 
perplane such that (po,v) = for every v G II. We first show how to construct locally S 
as the solution of the Hamilton-Jacobi equation ([55]) which vanishes on x, + II and such that 
VS*(a;) = po- Up to considering a smaller neighborhood V, we assume that H(x,po) ^ for 
every x £ V . For every x £ (x + LI) U V, set 



H(x,po) 
V H (x,Po) 
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Then, H(x,p(x)) = H(x,po) and p(x) _L II, for every x G V". There exists p > such that, for 
every x G (x + 11) U V, the solution (a:x(-),Pa:(-)) of (|35|) . satisfying ^(0) = x and ^(0) = X, 
is defined on the interval (— fi, fj,). For every x G (x + TV) U V and every t G (—p,,p,), set 
6(t,x) := x x (t). The mapping (t, a;) i— > 9(t,x) is smooth. Moreover, 0(0, a;) = x for every 
x G (i + II) U V and 0(0, x) = J2^i{p(x) , fi(x)} fi(x) does not belong to II. Hence there 
exists p G (0,/x) with B(x,p) C V such that the mapping is a smooth diffcomorphism from 
(—p,p) x ((x + IT) U B(x,p)) into a neighborhood V of x. Denote by (p = (t,tt) the inverse 
function of 9, that is the function such that (6 o <p)(x) = (t(x),7t(x)) — x for every x G V. 
Define the two vector fields X and P by 

X(x) := 0(t(x),7t(x)) and P(x) := p^^x)), Vx G V. 

Then, 

rn 

X(9(t,x))=9(t,x)=x x (t) = ^<p x (t),fi(x x {t)))Mx x (t)) 

i=l 

7) I 

i=l 

and 

rn rn 

^<P(^,x)),/ l (x :c (t))) 2 = 2<p x (t),/i(x x (t))) 2 = 2H(x,p(x)) = 2H(x,p ), 

i=l i=l 

for every t G (— p, p) and every x G (x+II)US(x, p). For every x G V, set a^(x) := (P (x), fi(x)). 
Hence, 

m m 

X(x) = y^aj(x)/j(x) and y^ai(x) 2 = H(x,p ), 

i=l i—1 

for every x G V. Define the function 5 : V i— ► II by 

S(x) :=2H(x,po)t(x), Vx G V. 

We next prove that VS(x) = P(x) for every x G V. For every t G (—p,p), denote by Wt '■= 
{%) G V | r(y) = f}. In fact, Wj coincides with the set of y G V such that <S(y) = 2H(x,po)t. 
It is a smooth hypersurface which satisfies VS(y) _L T a W t for every y £ W t - Let y G Wj be 
fixed, there exists x G (x + n) U -B(x, p) such that y = x) = x x (t). Let us first prove that 
P(y) — Px(t) is orthogonal to T y Wt- To this aim, without loss of generality we assume that 
t > 0. Let w G TyWt, there exists u G n such that w — d x 9 t (x)v. For every s G [0, i], set 
z(s) := d x 9(s,x)v. We have 

i(s) = ^-d x 9(s, x)v = x)v = ^-X(6(t, x))v = dX(9(t, x))z(s). 

Hence, 

(z ( s),p x (s)) + (z(s),p x (s)) 

m 

(dX(9(s,x))z(s),p x (s)) - (z(s),^2(p x (s),f l (x x (s)))df t (x x (s))*p x (s)). 

i=l 



ds 



(z(s),p x (s)) = 
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Since X(x) — Y^Li a i( x )fi( x ) an d YliLi a i{ x ) 2 — H( x >Po) f° r every x G V . there holds 

m m 

a J (x a; (s))c(/' l (x :c (s))*p :E (s) + (fj (x x (s) ) , p x (s) ) Va (a: x (s) ) 

i=l i=l 
m m 

= a l (x x {s))dfi (x x (s))*p x (s) + ^ a * ( x % ( s ))^ a i i x x (s) ) 

i=l i=l 
m 

= ^Oi(a; a .(s))4fi(x a ;(s))*p a! (s). 

i=l 

We deduce that -j^(z(s),p x (s)) = for every s £ [0,i\. Hence, 

(w,P(y)) = (w,p x (t)) = (z(t),p x (t)) = (z(0),p(x)) = 0. 

This proves that P(y) is orthogonal to T y Wt, which implies that P(y) and WS(y) are collinear. 
Furthermore, since S(x x (s)) = 2H(x,p )s for every s £ [0, i], one gets 

(VSfxxW),^*)) - 2H(x,p ) = (p x {t),x x (t)). 

Since i; x (t) = X(y) does not belong to T y W t , we deduce that VS(x x (t)) = p x (t). In conse- 
quence, we proved that V5(x) = P(x) for every a; € V. □ 

Let us now conclude the proof of Lemma 12.101 Clearly, there exists e > such that every 
solution {x{-),p{-)) : [0, e] -> R" x IT of ([35]), with x(0) = x and p(0) £ W, satisfies 

x(t)eB(x,p), Vt€[0,e]. 

Moreover, we have 

S(x(e)) - Sf(2) = 2eH(x,p). 

Let u(-) € L°°([0, e];R m ) be a control such that the solution y(-) : [0, e] -> W of (J37J) starting 
at x satisfies y(e) = a;(e). We have 

= 

^ (S(y(t)))dt 



S(x(e))-S(x) = S(y(e))-S(y(p)) 

d 



o dt 
(VS(y(t)),y(t))dt 



< / /%(t),dS(y(i))) + -5> i (t) 2 di 

, ' i=l 
/■e m 

= eH(x,p)+ / V«,(i) 2 (it. 
Jo • i 



The conclusion follows. 
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